Combining learning-based intensity distributions with nonparametric shape priors for image segmentation

Integration of shape prior information into level set formulations has led to great improvements in image segmentation in the presence of missing information, occlusion, and noise. However, most shape-based segmentation techniques incorporate image intensity through simplistic data terms. A common underlying assumption of such data terms is that the foreground and the background regions in the image are homogeneous, i.e., intensities are piecewise constant or piecewise smooth. This situation makes integration of shape priors inefficient in the presence of intensity inhomogeneities. In this paper, we propose a new approach for combining information from shape priors with that from image intensities. More specifically, our approach uses shape priors learned by nonparametric density estimation and incorporates image intensity distributions learned in a supervised manner. Such a combination has not been used in previous work. Sample image patches are used to learn the intensity distributions, and segmented training shapes are used to learn the shape priors. We present an active contour algorithm that takes these learned densities into account for image segmentation. Our experiments on synthetic and real images demonstrate the robustness of the proposed approach to complicated intensity distributions, and occlusions, as well as the improvements it provides over existing methods. Abdurrahim Soganli Faculty of Engineering and Natural Sciences, Sabanci University, 34956 Tuzla, Istanbul, Turkey E-mail: [email protected] Mustafa Gokhan Uzunbas Computer Science Department, Rutgers University, Piscataway, NJ 08854 USA E-mail: [email protected] Mujdat Cetin Faculty of Engineering and Natural Sciences, Sabanci University, 34956 Tuzla, Istanbul, Turkey E-mail: [email protected]